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Abstract 

We consider existential problems over the reals. Extended quantifier 
elimination generalizes the concept of regular quantifier elimination by 
providing in addition answers, which are descriptions of possible assign¬ 
ments for the quantified variables. Implementations of extended quantifier 
elimination via virtual substitution have been successfully applied to vari¬ 
ous problems in science and engineering. So far, the answers produced by 
these implementations included infinitesimal and infinite numbers, which 
are hard to interpret in practice. We introduce here a post-processing 
procedure to convert, for fixed parameters, all answers into standard real 
numbers. The relevance of our procedure is demonstrated by application 
of our implementation to various examples from the literature, where it 
significantly improves the quality of the results. 


1 Introduction 


We consider existential problems over the reals. Extended quantifier elimination 
generalizes the concept of regular quantifier elimination by providing in addi¬ 
tion answers, which are descriptions of possible assignments for the quantified 


elimination (Dolzmann and Sturm 


variables (Weispfenning 1994b 1997b). Implementations of extended quantifier 


1997a 


1996) via virtual substitution (Loos 


and Weispfenning! |1993| |Weispfenning[ 1997a| |l994al |1988| |Dolzmann et al.| 


1999) have been successfully applied to various problems in science and en- 


gineering (|Sturm and Weispfenning 

1997| Sturm 

1999b] 

Weispfenning 

2001 

Sturm and Weber 2008 Sturm et al. 2009| Errami et al. 

2011| Weber et al. 

2011 Errami et al. 

2013 

Sturm 1999a). 


So far, the answers produced by these implementations included infinitesimal 
and infinite numbers, which are hard to interpret in practice. This has been ex¬ 


plicitly criticized in the literature, e.g., by Collard (20031. In the present article, 


we introduce a complete post-processing procedure to convert, for fixed values 
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of parameters, all answers into standard real numbers. We furthermore demon¬ 
strate the successful application of an implementation of our method within 
Redlog (Dolzmann and Sturm 1997a) to a number of extended quantifier elim¬ 
ination problems from the scientific literature including computational geom¬ 


etry (Sturm and Weispfenning 1997), motion planning (Weispfenning 


bifurcation analysis for models of genetic circuits and for mass action (Sturm 


20011 , 


and Weber 2008 Sturm et al. 20091, and sizing of electrical networks (Strum 


1999a I. 

The plan of the paper is as follows: In Section [2] we make ourselves familiar 
with the concept of extended quantifier elimination. In Section [3] we give an 
introduction of virtual substitution for extended quantifier elimination to the 
extent necessary to understand how nonstandard values enter the answers and 
what information is available for fixing them to standard values. Section [4] is the 
technical core; we describe and prove our method and illustrate it by discussing 
one example in detail. In Section[5]we revisit degree shifts , a successful heuristics 
for reducing the degree of quantified variables before their elimination. We re¬ 
interpret these degree shifts as quantifier eliminations by virtual substitution. 
This allows us in Section [6] to generalize our method to cover also possible 
degree shifts during elimination. In Section [7] we revisit examples from the 
scientific literature where the application of extended quantifier elimination to 
various problems from planning, modeling, science, and engineering had yielded 
nonstandard answers. In all cases we can efficiently fix all nonstandard symbols 
to standard values using our implementation of the method as it was introduced 
in Section [4]and generalized in Section [6] This significantly improves the quality 
of the results from a practical point of view. Finally, in Section [8] we summarize 
our results and discuss possible extensions of our method. 


2 The Concept of 

Extended Quantifier Elimination 

For our purposes here, we restrict ourselves to existential problems 

5 • • • i 'U'm ) = 3x n . . . ...,X n ,Ul,..., Um) 

in the Tarski language L = (0,1, +, <, >, >, /) interpreted in the Tarski 

algebra (R, 0,1, +, —, •, <, <, >, >, y^). As usual in algebraic model theory, the 
symbol “=” and its interpretation as equality is part of first-order logic so that 
it does not occur explicitly in the language L. Without loss of generality, if 
is an A-V-combination of atomic constraints, and we agree that all right hand 
sides of the atomic constraints are 0. 

Extended quantifier elimination applied to ip yields an extended quantifier 
elimination result (EQR) 


ft(u) 

Xi = en(u) 

%n — ^ln(u) 

ftb(u) 

xi = efci(u) 



The conditions /?,;(u) are quantifier-free Tarski formulas such that R |= ip <—> 
Vt=i ft- I n other words, Vi=i ft is a regular quantifier elimination result for ip, 
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and extended quantifier elimination generalizes regular quantifier elimination. 
The answers e.;(u) are terms in an extension language of the Tarski language. 
For a € R m , if p{a) holds, then at least one /3*(a) holds, and so does ip(ei(a), a). 
We agree that “false” never occurs as a condition. If ip itself is equivalent to 
“false,” we possibly obtain the empty scheme [ ]. 

As an example, consider the input formula 

<p = 3x3 yip, ip = ay + 3x 2 + Ax<aAx>a>y. 


A possible extended quantifier elimination result for tp is given by 


ay^0A4a + 3>0 

y = —3a — 3 

x = a 



V-3 a 2 + 3a + 4 - 2 

a < 0 A 3a 2 — 3a — 4 < 0 

y = a 

x — - 

3 


From this extended quantifier elimination result we can derive a regular quan¬ 
tifier elimination result 

(a ^ 0 A 4a + 3 > 0) V (a < 0 A 3 ci 2 — 3a — 4 < 0), 

which can be simplified to a > 0 V 3a 2 — 3a — 4 < 0. Hence, <p holds if and only 
if a > a, where a « —0.758306 is the smaller root of 3a 2 — 3a — 4. 

In the extended quantifier elimination result, the first row covers the case 
that —0.75 < a and a / 0, while the second row covers a < a < 0. Let us 
consider some particular interpretations of a: 

• For a = 2, the condition in the first row holds and the corresponding 
answers yield x = 2 and y = —9. In fact, these three values satisfy ip. 
The condition in the second row, in contrast, does not hold. If we plug 
a = 2 into the corresponding answers anyway, then we obtain a negative 
argument for the square root, which cannot be interpreted over the reals. 

• For a < a = —0.7525 < —0.75, the condition in the second row holds and 
the corresponding answers yield x = ' /69 ] 9 2 ' 0 q 80 ° and y = —0.7525. Again, 
these three values satisfy ip. Now the condition in the first row does not 
hold. If we plug a = —0.7525 into the corresponding answers anyway, then 
we obtain x = —0.7525 and y = —0.7425, which does not satisfy ip. 

• For a = —0.5, both conditions hold and yield two different sets of val¬ 
ues satisfying ip, viz. x = —0.5, y = —1.5 and x = ^T 4 , y = —0.5, 
respectively. 

• For a = 0 only the condition in the second row holds, but the answers in 
the first row happen to work as well. This shows that the conditions are 
sufficient but not necessary for the answers to be valid. 

3 The Method of Virtual Substitution 

Given <p(u) = 3xip(x, u), we compute a finite elimination set 

E ={..., (q(u), e(u)),} such that 3xip <—» \J 'yAip[x//e\. (1) 

(7 ,e)£E 
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In the elimination set E the e(u) are elimination terms substituted for the 
quantified variable x via a virtual substitution [x // e]. The 7 are quantifier-free 
Tarski formulas serving as substitution guards. Equation ([I]) formally describes 
regular quantifier elimination of one quantifier 3a: from <p. For the elimination 
of several quantifiers, one assumes without loss of generality that the formula is 
prenex and processes the prenex quantifier block from the inside to the outside. 

We are now going to give an idea of the exact shape and computation of elim¬ 
ination sets that is sufficiently precise to understand our main contribution here. 
For a more thorough introduction into the theory of quantifier elimination by 


virtual substitution we refer to the original publications by Weispfenning (1988 


1994a 1997aI, Loos and Weispfenning (19931, and Dolzmann et al. (19991. In 


Section 3.1 we restrict ourselves to input formulas tp not containing any strict 
inequalities “<,” “>,” or “yL” In that course it will become clear how exactly we 
derive extended quantifier elimination from the virtual substitution procedure. 

Later, in Section |3.2| we generalize to formulas containing also strict in¬ 
equalities. While with regular quantifier elimination the techniques used in the 
course of the generalization to strict inequalities remain completely transpar¬ 
ent to the user, with extended quantifier elimination they leave visible traces 
in the answers by possibly introducing certain nonstandard elements, which do 
not have a straightforward interpretation over the reals. The purpose of this 
paper is to convert these answers to real numbers, given fixed values for the 
parameters. 


3.1 Virtual Substitution for Weak Inequalities 


Recall that our constraints are normalized such that their right hand sides are 
0. Assume that all occurrences of x in y>(u) = 3 xip(x, u) are at most quadratic. 
Consider fixed real interpretations u = a £ R m for all parameters. Then all 
constraints in ip(x, a) become univariate, and the set { c £ M | ffi. \= i/>(c, a)} 
is a finite union of real intervals, where the interval endpoints are zeros of the 
univariate left hand side polynomials. 

Our goal is to include at least one such interval endpoint into our elimination 
set E: For each constraint f2(u)x 2 + /i(u)a; + /o(u) g 0, with a weak relation 
g £ {=,<,>} and discriminant A = f 2 — 4/2/0 we add to E three pairs ( 7 , e) 
as follows: 




/ 2 /oaa>o, 


-h-VA 

2/2 


h = OA/r/ 0 , 



In order to obtain a quantifier-free equivalent for ip, such pairs have to be plugged 
into (p according to ([l]). To start with, note that the substitution guards 7 make 
the substitution terms e meaningful by ensuring that denominations are not zero 
and arguments to square roots are not negative. 

Next, observe that our elimination terms e are not terms in the Tarski lan¬ 
guage as they contain division as well as root symbols. It is one central idea of 
the virtual substitution approach that the substitution operator does not map 
L-terms to L-terms but atomic L-formulas to quantifier-free L-formulas: 


\x //1] : atomic L-formulas —> quantifier-free L-formulas 
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Note that when there is more than one quantifier, it is crucial to obtain L- 
formulas in ([I]) in order to be able to proceed. 

To give an impression of virtual substitution, we describe here the substitu¬ 
tion (/ = 0)[x H 9l+9 g^^ } of a root expression 


9l + 92y/gs 


9 4 


9i e Z[u] 


into an equation / = 0, where / € Z[u][x] of arbitrary degree: It is easy to see 
that there are gt, g%, g% such that 


J 9l+92y/g3 \ = gt +92V93 
V 9A ) gt 


is again a root expression. Using this intermediate result, we transform 
9*i +9tV93 


91 


= 0 = g{+ 32^33 = 0 


= \g*i\ = I 52 V 53 I A 

(sgn( 5 *) ± sgn(^) V sgn( ff *) = sgn(^) = 0) 

= 9\ ~ 9-i 93 = 0Ag 1 g 2 < 0. 

Technical details and formal descriptions of virtual substitutions for all our 


relations have been given by Weispfenning (1997a I. 


Let us now apply these ideas to extended quantifier elimination of several 
existential quantifiers via virtual substitution. Given 

3x n ... 3xiip(xi, ...,x n ,ui 

5 • • • 5 ^m) 

our intended result is a scheme as described in Section [2] 


£l(u) 

Xi = eu(u) 

%n — ^ln(u) 

Pk{ u) 

xi = efci(u) 



We successively apply ([!]) to X\, ..., x n using elimination sets E\{x 2 ,..., x n , u), 

..., E n ( u) to obtain Pi, ..., pi~ as follows: 

V ' V 7 n a (• • • A (71 A ijj[xi // ei]) ■ • • ) [x n // e n \ . (2) 

(7n,e„)6E„ ( 7 i,ei)eSi ' TTT ' 

A(«) 

The index i of Pi describes one choice (('y n , e n ),..., ( 71 , ei)) from the Cartesian 
product E n x • • • x E\. In practice, the pi obtained this way undergo sophisti¬ 
cated simplification methods such as those described by |Dolzmann and Sturm| 
(1997b). Recall from the previous section that Pi that become “false” are ig¬ 


nored. It is important to understand that for the computation of the pi we are 
using exclusively virtual substitution. 

The corresponding e;(u), in contrast, are obtained from e„(u), e n _i(x n ,u), 
..., ei(x 2 ,... ,x„,u) via regular back-substitution of terms in an suitable exten¬ 
sion language of L: 


&i,n — 7 G,n— 1 — &n—l [x n /ej ;n ], e^i — e \ [Xi /Cj^] • • ■ \^'nf^'i./n\• ( 3 ) 
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Note once more that the back-substitution possible creates objects like 


3 a / J5u\ - U 2 — 2 
Ul+ 2 ’ 

which are not L-terms or even root expressions. It is thus suitable for obtain¬ 
ing the e. ( but not for the /3j. Vice versa, virtual substitution requires atomic 
formulas as input. Thus it is suitable for obtaining the /3j while for the e, it 
is not applicable at all. Virtual substitution and regular term substitution are 
independent concepts, which complement each other. 

3.2 Virtual Substitution with Strict Inequalities 

Let us return to the elimination of a single quantifier from 3xip(x,u). Recall 
from the beginning of the previous Section |3.1| how we considered fixed inter¬ 
pretation u = a £ R m causing the set S = { c £ R | R |= a) } to be a finite 
union of intervals. 

When considering in addition strict inequalities, the intervals in S are pos¬ 
sibly open. Consequently, for a strict constraint 


V>*(s,u) = f i 2 (u)x? + fil(u)Xi + fio(u) Qi 0, ft £{<,>,/}, (4) 


contained in ij){x, u) we cannot use the zeros z,(u) of the left hand side but need 
a point from inside the corresponding interval. 

In early versions of virtual substitution methods for the linear case, [Weisp fen-| 


mng 


(19881 used arithmetic means \(zi + Zj) for all pairs {ipijipj) of strict con¬ 
straints. However, the size of the elimination set then grows quadratically in 
the number of constraints, which turned out to be critical for the practical per¬ 
formance of the method (Burhenne 1990 Loos and Weispfenning 1993). For 


the quadratic case, observe that expressions 


1 / -ffq ± \fKj -gji ± y/A~ \ 

2 y 2^,2 Zgj2 J 


are not root expression of the form 


gt+g* 2 V A* 


9 3 


so that Weispfenning’s (1997a) virtual substitution rules sketched in the previous 


Section I3dl cannot be used. 

The established approach for strict inequalities uses nonstandard extensions 
of R: Let e £ R* D R be a positive infinitesimal number, i.e., 0 < e < x for all 
0 < x £ R. Then for a strict constraint as defined in 0 we use four test points 


-fa ± 

2 /i2 


± £. 


As an optimization, it suffices to consider only upper bounds using —e. For 
solution sets that are unbounded from above we have to add only one more 
point oo := 1/e £ R* for the entire problem. 
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For the application of the elimination set as described in ([I]) and thus for 
the computation of the with extended quantifier elimination, both e and oo 
are equivalently translated into the Tarski language L via virtual substitution. 
For instance, let t be a standard term. Then 


(a; 3 + x 2 — x — 1 < 0) [x //1 — e] = 

(a; 3 T a? 2 — x — 1 < 0 V (a; 3 + i 2 -a;-l=0A (3a; 2 + 2x — 1 > 0 V 

(3a; 2 + 2a; — 1 = 0 A (6a; + 2 < 0 V (6a; + 2 = 0 A 6 > 0))))))[x // 1]. 


In a subsequent step, t can be virtually substituted for x as discussed in the 
previous section. For understanding the principal idea, notice that 3a ; 2 + 2a; — 1, 
6 a; + 2 , and 6 are the first, second, and third derivatives of a ; 3 + a ; 2 — x — 1 , 
respectively. For the substitution of oo we have, e.g., 


(ax 2 + 6 x + c<0)[a;//oo]=a<0V(a = 0A&<0)V(a = 0A& = 0Ac<0). 

Again, precise definitions and proofs have been given by Weispfenning (1997a]). 

When again performing regular back-substitution of terms on the side of 
the e*, nonstandard symbols cannot be removed but are propagated along the 
way. In the final result a single answer can even contain several of such 
nonstandard symbols. For example, on input of 


ip = 3x3 yip, ip = ay + 3x 2 + 4x < 0 A x > y > a 


(5) 


we obtain a nonstandard extended quantifier elimination result: 


a + 4 < 0 
a<OAa+4>0 


—a — 3ei — 3^2 — 4 —a — 3ei — 4 

y= - ^- x= --- 


y = -ei - £2 


X = —£i 


• ( 6 ) 


Given such answers containing nonstandard symbols, it is not hard to non- 
constructively prove from the elimination procedure that for fixed real interpre¬ 
tations of the parameter a there are positive real choices £i, £2 £ R so that 
the answers satisfy ip. Infinitesimals introduced at different stages of the elim¬ 
ination are indexed accordingly. It is noteworthy that they have to be chosen 
differently in general: Fixing a = —2 in the example, it is easy to see that £1 
has to be chosen different from e 2 because otherwise we would obtain y = 2x, 
which together with a = — 2 does not satisfy ay + 3x 2 + 4x < 0. 

Until now users of extended quantifier elimination were left alone with results 
as in Q. In spite of the difficulties discussed above, there is a considerable 
record of applications of extended quantifier elimination in the literature. We 
are going to discuss some of these with our examples in Section [7] 

We conclude this section with an important observation that for unfixed 
parameters it is not possible in general to determine suitable real choices for 
nonstandard symbols: 

Proposition 1 (No Standard Answers for Unfixed Parameters). Consider the 
formula p = 3x(a < x < 1 ) and the nonstandard extended quantifier elimination 
result 

[ a<l | x = 1 — £1 ]. 

There is no standard choice fy £ R. such that [ a<l | x = 1 — £\ ]isan 
extended quantifier elimination result for ip as well. 


7 














Proof. Assume for a contradiction that £\ £ R is a suitable choice. Then by 
definition of extended quantifier elimination it follows for all a £ ]—oo, 1 [ that 

a < 1 — ei<l, in particular £i > 0. On the other hand, for ao = 1 — ^ we 
have ao £ ]—oo, 1 [ and 1 — ey < ao < 1 , a contradiction. □ 


4 Elimination of Nonstandard Symbols 
from Answers 


Given an extended quantifier elimination result and prescribed values for all pa¬ 
rameters, our goal is to compute answers containing only standard real numbers. 
For instance, given ^ and (JgJ) , and fixing a = — 2 we are going to obtain 


■ 

9 

1 i 

true 


x = - 


V ~~256 

32 


From the point-of-view of our method, it makes no difference whether the 
parameters are fixed after extended quantifier elimination or in advance. For the 
sake of a concise description, we are thus going to restrict to existential decision 
problems from now on. Recall that if the regular quantifier elimination result 
is “false,” then the extended quantifier elimination result is [ ], i.e., empty. If 

the result is “true,” then we assume for simplicity that the extended quantifier 
elimination result contains only one row, like 


[ true | Xi = eyi 


%n — &l,n 


(7) 


Recall from ^ in Section 3.1 that here the ei i, ..., ei i7l have been obtained 
from elimination terms ei, ..., e n via regular back-substitution. Our method 
is going to use not the back-substituted answers but these original elimination 
terms. In addition, we are going to use the substitution guards 71 , ..., 
substituted with those elimination terms in ([2|. Hence the input for our method 
is not an EQR like in 0 but a pre-EQR as follows: 


true 

Xi = ei(* 2 , • 

• 1 %n) 

• 1 — ^n—l(*^n) 

%n — ^n() 


71O2, • 

• 5 *En) • 

7 n _l(x n ) 

7 n() 


Lemma 2 (Semantics of Virtual Substitution). Let ip(x ±,... ,x n ) be a Tarski 
formula, and let 02, ..., a n £ R. 


(i) Assume that R |= ip{Xi H £2 — £](a2,..., a n ). Then there is £0 £ R, 0 < £0, 
such that for all e £ R, 0 < e < &o, we have R |= 99(02 — £, 02,..., a n ). 

(ii) Assume that R \= <p\x\ H 00] (02,..., a n ). Then there is do £ R, such that 
for all o) £ R, Oo < Oi, we have R (= 99(0), 02,..., a n ). In particular, 
the set T = {o£R| 0 <o and R \= 93(0,02,..., a n ) } is unbounded from 
above. 


Proof. Consider L e = L U{e, 00 }. Using the compactness theorem for first-order 
logic, there is a real closed field R* where the interpretation of £ is a positive 
infinitesimal and 00 = £~ 1 . The L-restriction of R* is a proper extension field of 
R and, by the Tarski principle, elementary equivalent to R. Formally, R*|L D R 
and R* \L = R. 









(i) Using R = R*| L and expanding to R* it follows from R \= ip[x i // X 2 — 
e](o 2 j. • •, o„) that also R* \= ip[x\ // X 2 — e](a 2 ,..., a n ). It has been dis¬ 
cussed by Loos and Weispfenning ( 1993| ) and Weispfenning ( 1997a| ) that 
for our a- 2 , ..., a n £ R the virtual substitution of e has the following 
property: 


R* |= <p [.El // x 2 - e](a 2 , ...,a n ) <—t <p[xi/x 2 - e](a 2 ,... ,a„). 

It follows that R* |= (£>[xi/x 2 — e](a 2 ,..., o„). Let n £ N \ {0}. Then we 
can conclude R* |= ip [xo/e] (a 2 ,..., a n ), where 

ip = (0 < Xq A nxo < 1 A y>)[xi/x 2 — Xo]. 

Now we can generalize R* |= 3xaip(a,2, ■ ■ ■ ,a n ). Since e does not oc¬ 
cur anymore, we restrict from R* to R*|L and then use the elemen¬ 
tary equivalence to obtain R |= 3xoip(a2, ■ ■ ■ ,a n ). We have just shown 
that for any n £ N \ {0} there exists ao £ R, 0 < ao < ^, such that 
R 1= ip(a .2 — ao, 0 , 2 ,..., a n ). It follows that inf S = 0, where 


S'={a£R|0<a and R \= y:(a 2 — a, a 2 ,..., a n ) }CR. 


On the other hand, S' is a semialgebraic set and thus a finite union of 
intervals and points. Hence there is &o £ R, 0 < £q, such that ]0,&o[ C S. 


(ii) The argument is essentially the same as in (i) above: We conclude that 
R* |= <p[x 1 H 00] (a 2 ,... ,a n ). According to Loos and Weispfenning (19931 
and Weispfenning ( 1997a]) we know that 


R* |= <p[x\ H 00] (a 2 , ..., a„) < — > <p[xi/oo ](a 2 ,...,a„) 


so that for n £ N we can conclude R* |= '0[xo/oo](a 2 ,..., a n ), where 
ip = (n < x 0 A tp)[xi/x 0 \. 


Again, we generalize, restrict, and apply elementary equivalence to obtain 
R |= 3xo ip(a 2 , ■ ■ ■ ,a n ). We thus know that for any n £ N there exists 
ao £ R, n < ao, such that R |= <p(ao, a 2 ,..., a n ). It follows that the set 
T is unbounded from above. On the other hand, T is a semialgebraic set 
and thus a finite union of intervals and points. Hence there is ao £ R, such 
that ]ao, 00 [ C T. □ 

Lemma 3. Consider a quantifier-free Tarski formula ip{ x i, - • •, x n ). Assume 
that for each i £ { 2 ,..., n} we have a root expression ej = a ' +b d "^ with a t , bi, 
Ci, di £ Z[xj+i,..., x n }. Assume furthermore that R \= %p —> Ci > 0 A di 7 ^ 0, 
and let a* £ R be the interpretation of e* = ej[xi+i/ei+i]... [x n /e^]. Then 

{a £ R | R 1= ip[x 2 // ea] ■ ■ ■ [x„ //e^](a) } = {a£R|R|= ip{a,a 2 ,. • • ,a n ) }. 

Proof. Consider Li = LU{^r, _1 } and the L'-expansion R' of R where ^J~ and -1 
have the usual semantics if defined and an arbitrary but fixed value otherwise. 
Let v = (/ g 0), where / £ Z[x, tti,..., u m ], g £ {<,<,>,>, 7 ^,=}, and let 
e = a+ ^^ , where a, b, c, d £ Z[ui,... ,u m \. Let s £ R m such that c(s) ^ 0 
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and d( s) ^ 0. Then according to |Weispfenning| (|l997a| the following holds for 
s £ R m : 

M' |= (v\x H e] 4—> v[x/e])(s). 

For our formula ip and all a £ R we obtain 

R' |= (ip[x 2 // e 2 ]... [x n //eff\ 4 —> ip[x 2 /e 2 \.. ■ [x n /ef] 4 —4 ip)(a,a 2 ,... ,a„). 

It follows that R |= (ip[x 2 H C 2 \... [x n // efP] 4 —> V0(a, a 2 , ■ ■ ■, a n ) for all atl. 

□ 

Lemma 4 (Commutation of Virtual Substitutions). Consider a quantifier-free 
Tarski formula ip(xi,... ,x n ). Let e\ = ■ ai+ ^ v '°S with cii, bi, ci, d\ £ Z, 

Ci ^ 0, di ^ 0. Furthermore, let i £ {2,..., n}, let = a ' + ^' with a,i, bi, Ci, 
di £ Z[xj+i,..., x n \, and let 7 i(xj+i,..., x n ) be a quantifier-free formula such 
that R 1= 7 j —> Cj ^ 0 A di / 0. Then 

R \= (7» A VO [Xi // ei] [xi // ei] 4—4 ( 7 , A ip) [xi H ei] [x* // e*]. 

Proof. Let L ', R' be as in the proof of Lemma [3j Recall the equivalence R' |= 
(v[x H e] 4 —> v[x/e])(s) and observe that, on the other hand, if R |= (a < 0)(s) 
or R |= (di = 0)(s) for s £ R n- % then R |= ( 7 j A ip 4—> false) (s). It follows that 


H (7i A VO i x i II e i\ l x i II e i] 


(7® A V , )[ a; i/ e i][ a: l/ e l] 

(7i A V0[ a 'l/ e l][ a: i/ e i] 

(7i A VOfci // ei][xj //ei]. 


Since virtual substitution eliminates all occurrences of y and 1 , we can con¬ 
clude that R |= ( 7 , A VO [xi // e*] [xi // ei] 4—4 ( 7 , A ip) [xi // ei] fx* // e*]. □ 

Theorem 5 (Computation of Standard Answers). Consider a closed Tarski 
formula <p = 3x n ... 3x\ip(xi,..., x n ). Assume that 


true 

xi = ei 

%n — 


7i 

7n 


is a pre-EQR for tp such that each ei is of one of the following forms: 

(a) a root expression a+ y ^ ? where a, b, c, d £ Z[xj+i,... ,x n ], 

(b) 00 , 

(c) x i+ i - e. 

Then we can compute root expressions el, ..., meeting the specification (a) 
above and 7 ), ..., 7 ]/ such that the following is a pre-EQR for 73 as well: 

( 8 ) 


true 

xi = ei 

• %n — 6 n 


7i 

7n . 
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Proof. For the sake of the proof, we are going to show that in addition to the 
required e[, ..., and 71 , 7 O we can compute real algebraic numbers 
a\, ..., a n for the values of el, ... ,'ef after back-substitution. We represent 
these real algebraic numbers as pairs of univariate defining polynomials and 
open isolating intervals with rational bounds. Given k £ {1,... ,n}, it suffices 
to show that from 


true 

x\ = ei 

II 

-S£ 

*£/c+l — ^fe +1 

H 

3 

II 

. 

7i ■ 

7 ft 

7fe+i • 

In . 


and ckfc+i, ..., a n we can compute suitable e k , 7 k , and a*,. Define 


ip k (x k ,...,x n ) = (jk-i A--- A71 A'tf)[x 1 //ei\...[xk-i//ek-i}, 
ip k+1 (x k +i,...,x n ) = (7ft A ip k ){xk //e k ], 


and observe that 


and 


true 

II 

+1 - ^fe+1 

• %n — 

. 

Ik 

7fe+i 

7n _ 


true 

*£& +1 — ^fc+1 

%n — 

. 

lk+l 

7 n . 


( 10 ) 


are pre-EQRs for 3x n ... 3xk<fik and 3x n ... 3x k +i(pk+h respectively. On the 
basis of these definitions it is sufficient for our proof to compute suitable e k , 7 O, 
and a k such that 


true 

) ^ 
<<D 

II 

-Sd 

%k-\- 1 — &k-\- 1 • 

%n — 

. 

7 ft 

Tfc+i 

7n . 


is a pre-EQR for 3x n ... 3x k <fk as well. We define furthermore 


f(x k , ...,x n ) = 7 n A • • • A 7 fc+i A 1 pk, 

£'(zft) = f{x k+ i //ek+\] • ■ • [x n //e^]. 

Lemma [3] applied to the quantifier-free formula £, the root expressions Ok+\ , 
..., e)(, and the real algebraic numbers a k + 1 , • • •, a n yields 


{ r <E R | R |= £f {r ) } = {r€R|l|= £(r, a k+ll ..., a n ) }. ( 11 ) 


We distinguish three cases depending on the type of e k . 

(a) We have e k = and 7 *, equals d k y^ 0 A c k ^0. We set e k = e k and 

7ft = 7ft- Since (flO) is a pre-EQR for 3x n ... 3x k +iy k +i and a k +i , .. -, a n 


correspond to the values of ejffi, ..., ef, after back-substitution, we have 
R |= ip k +i(a k +i ,..., a n ). It follows that in particular R |= 7 ^( 0 ^+!,..., a n ) 
and furthermore R {= d k (a k+ 1 ,..., a n ) y^ 0 and R (= c k {a k+ 1 ,..., a n ) ^ 0. 
This allows us to compute a k = ek(a k +i , ■ ■ ■, cx k ) from a k , b k , c k , d k , a k + 1 , 
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(b) We have ej, = oo, and 7 k is “true.” Since ([£]) is a pre-EQR for formula 
3x n ... 3 Xk<Pk we have 

R \= £\ x k // 00 ] [x k+1 H eH+i\. .. [x n H eH\. 

Using the fact that otk+i, ..., a n are real algebraic numbers corresponding 
to the values of ek+i, ..., el after back-substitution we conclude that 


R (= £[xk // oo](a fc +i,..., a n ). 

Lemma [2^ii) now guarantees that the set { r £ R | K |= £(r, ctk+ 1 , ■ ■ ■, a n ) } 
is unbounded from above. Thus by (111 the set { r £ R | R |= £'(r) } is 
unbounded from above as well. Using well-known bounds (Akritasj 2009) 
on the roots of the univariate polynomials contained in £ 7 , we compute a 
sufficiently large - € Q satisfying I'. We set el = and construct 

a corresponding real algebraic number a*,, and we set yl = true. Then 
R |= (Tfe A £ 7 )[:Cfc H el], and n — k applications of Lemma [2] yield 

R ^ (7 n A • * * A 7 fc A (pi!) [xk // ek\ H e/c-t-i] • ■ ■ [ x n H e n ] . 


(c) We have ek = Xk+i — £, and 7 k is “true.” Similarly to case (b), we observe 
that © is a pre-EQR for 3x n .. .3xk<fik and obtain 

R ^ H Xk -(-1 £] H ^fc+i] ■ • - \x n H e n J , 

and conclude that R |= £[ 2 ^ H Xk+i — e](ak+ 1 , • ■ ■ ,a„). Lemma [2^i) now 
guarantees the existence of some £q £ R, 0 < £q, such that 


\= £(a k +i - £,a k +i, ■ ■ ■ ,a n ) for 0 < £ < e 0 . 


By (111 it follows that R \= ^'(afc+i — e) for all 0 < e < £q. Therefore, after 
finitely many refinements of the isolating interval ] ^,u[ of otk+i we obtain 

R 1= C (“)■ We set el = P+Qx ^ and construct a corresponding real algebraic 
number, and we set 7 1 = true. Exactly as in case (b), R |= (jl A£')[ 2 fc H el], 
and n — k applications of Lemma [4] yield 

R ^ (7 n A * * * A 7 k A ’Pk) [xk H ek\ H e/c-(-i] ... [ x n H e n ]. 


Note that instead of using the lower bound ^ one can heuristically try and 
find a satisfying integer. □ 

A careful inspection of our proof reveals that in all cases 7 ^ = 7 However, 
this is going to change in Corollary [TJ which generalizes our theorem. 

Notice that the constructive proof of Theorem [5] suggests to recompute the 
intermediate quantifier elimination results ipk■ In practice, there are arguments 
for saving these ipk during the quantifier elimination run. Consider, e.g., the 
following common optimization: Whenever some ifk heuristically simplifies to a 
disjunction tpk,i V • • • V Pk,si then the virtual substitution procedure would treat 
each ifik,j separately, i.e., like originating from several elimination set elements. 
In general, in the course of the application of Theorem [5] such transformations 
cannot be reconstructed exclusively from the pre-EQR. 
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To illustrate the theorem we revisit our example given in (|5| on page [7] for 
the choice a = —2. In that case V’ in © specializes to 

= —2 y + 3a; 2 + 4a; < 0 A x > y > —2. 


For our theorem we have to consider the following pre-EQR corresponding to 
the specialization of the EQR © to a = —2: 


true 

y = x — e 

x = h — £ 

o 

II 


true 

true 

true 


( 12 ) 


Notice the introduction of an artificial variable h to meet the requirement of the 
theorem that infinitesimals occur only in expressions of the form Xi = Xi + 1 — e. 
To apply the theorem to the pre-EQR (121, we consider 


¥>i (y,x,h) 
(fi 2 (x,h) 

<P3 (h) 


—2 y + 3a; 2 + 4a; < 0 A a : > y > —2, 
<Pi [y II x-e] 

x + 2 > 0 A 3a; 2 + 2a; < 0, 
ip 2 [x// h-e] 

/i + 2>0A(/i = 0V 3 h 2 + 2 h < 0). 


As in the theorem, we proceed from the right to the left, i.e., our first 
fixing h and computing a respective algebraic number ah- Since h = 0, 
in case (a). Now 


true 

3- 

II 

o 


true 


step is 
we are 


is a pre-EQR for Bhips. Therefore, ah is the root of the polynomial h in the 
interval ]—1,1[, i.e., ah is the rational number 0. 

We continue with x = h — e, which is case (c). Now 


true 

x = h- — £ 

O 

II 


true 

true 


is a pre-EQR for 3x3hip2- Lemma |2ji) ensures that there exists £q £ M, 0 < £o 
such that for all e € R, 0 < e < £q, we have R |= <p 2 (ah — e, ah)- Refining ah we 
compute that R |= (p 2 (a x ,ah)i where a x is the root of 32a; + 1 in the interval 
] — yg, i.e., a x is the rational number — A. 

Finally consider y = x — e, which is again case (c). Now 


true 


y = x — £ x = — ^ h = 0 
true true true 


is a pre-EQR for 3y3x3hipi- Lemma|2])i) ensures that there exists £q £ R, 0 < £o 
such that for all e £ R, 0 < e < £q, we have R \= <pi(a x — e,a x ,ah)- Refining 
a x we compute that R |= ipi(a yi a x , ah), where a y is the root of 256 y + 9 in the 
interval ] — ^[, i.e., a y is the rational number — ^fg. To conclude we state 

that 


true 

y ~ 256 

_,|<N 

|ro 

II 

H 

o 

II 


true 

true 

true 
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is a pre-EQR for 3y3x3hipi, which does not contain any nonstandard symbols. 
Since h does not occur in ip\ = ip, 


true 

y 256 

_h|(M 

^Ico 

1 

II 


true 

true 


is a pre-EQR for 3y3xip. 

Finally, note that all quantified variables have to be present in a pre-EQR 
before Theorem [5] can be applied. This has a consequence, which we illustrate 
on an example. Consider a valid sentence 3x3a(x < a). An extended quantifier 
elimination result containing a nonstandard symbol for this formula is 

[ true | a = oo ] . 

Since x does not occur in this result, it can be “freely chosen,” i.e., the result is 
independent of the value of x. Put another way, this means that 

[ true x = t a = oo ] 

is an extended quantifier elimination result for any standard term t as well. This 
degree of freedom disappears when computing standard answers in the following 
sense: The term t has to be fixed before the computation of standard answers. 
Fixing t = 2 and using Theorem [5] we obtain a standard EQR 

[ true | x = 2 a = 3 ] . 

The computed standard answer for a depends on this choice of t, i.e., it is 
possibly invalid for other choices. Fixing for example x = 4, we see that a = 3 
is not admissible anymore, because substituting these terms into (x < a) yields 
“false.” To compute a standard term for a when x = 4, we have to start with 

[ true x = 4 a = oo ] , 

and apply Theorem [5] again. 


5 Degree Shifts by Virtual Substitution 


We have already discussed that the feasibility of the virtual substitution method 
strongly depends on the degrees of the quantified variables. Among the heuris¬ 
tics for decreasing these degrees there is an observation, which was essentially 
made already by Weispfenning (1997aI, and which was refined and named de¬ 


gree shift by Dolzmann et al. (1998). The following lemma restates the result 
by Dolzmann et al"| 


Lemma 6 (Degree Shift). Consider a quantifier-free Tarski formula ip. Let 
g be the GCD of all exponents of x in ip. We divide all exponents of x in ip 
by g yielding ip'. If g is odd, we have 3xip <—> 3xip', if g is even we have 
3xip < — 3x{x > 0 A ip'). For g > 1 this reduces the degree of x in ip. In order 
to obtain larger GCDs and hence a better degree reduction, we may in advance 
“adjust” the degree n > 0 of x in polynomials of the form x n f, where x does 
not occur in / as follows: In equations and disequations, n may be equivalently 
replaced by any m > 0. In ordering inequalities we may choose any to > 0 of 
the same parity as n. □ 
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We now want to reanalyze this result as a special case of virtual substitution. 
For this, we have to slightly generalize the framework by introducing shadow 
quantifiers. Recall that we are considering existential problems of the form 

(p(ui,... ,u m ) = 3x n .. .3x!ip(xi,... ,x n ,ui , . . . , Urn) • 

As a first step we now switch to the equivalent problem 

<p(ui ,..., u m ) = 3x n 3x n ... 3x\3x\ijj{x\, ...,x n ,ui 5 • • • 5 ^m) i 

where {.Ti,..., x n } D {xi ,..., x n , zq,..., u m } = 0. That is, the variables 27 do 
not occur in ip. Consequently, proceeding with the elimination as discussed in 
Section [3J each shadow quantifier 3x, t imposes a trivial elimination problem. 

Strictly following the virtual substitution framework, one would not sim¬ 
ply drop those quantifiers 3xi but eliminate them via trivial elimination sets 
like {(true,0)}. Notice that one cannot use 0 as an elimination set here be¬ 
cause \J 0 = false. Furthermore, from the point of view of extended quantifier 
elimination the use of {(true, 0)} formally provides answers also for aq, ..., x n . 

Consider now w.l.o.g. the elimination of 3aq, and assume that we are in the 
situation of Lemma|6] where g > 1 is the GCD of the, possibly adjusted, degrees 
of xi in ip. We use an elimination set that depends on the parity of g: 

E= {(7, 

where 7 is aq > 0 if g is even and “true” otherwise. Of course, we have to define 
a suitable virtual substitution of i[i\ for aq within ip: 

{ ^ I m ax( j, g ) I \ 

X] a A 9 eoj, 

where aq, ..., ak £ Z[x 2 , ■ ■ ■ ,x n ,ui,... ,u m ] and g £ {=, <, <, >, >, ±}. The 
floor function is applied to make the definition complete; with our elimination 
sets we will always have divisibility g \ max(j, g). The max operator takes care 
of possible degree adjustments made for the computation of E. 

Observe that in contrast to the elimination sets studied so far we introduce 
here a variable x\ which was not present in ip before. That variable is bound by 
shadow quantifier 3x\. Intuitively, for the elimination of 3xi3x± we switch from 
one hard plus one trivial elimination step to two nontrivial elimination steps. 

The termination of quantifier elimination with shadow quantifiers follows 
from the termination of the underlying quantifier elimination method plus the 
fact that there are only finitely many shadow quantifiers for each regular quan¬ 
tifier. 

To keep the notation simple, we will in the sequel not formally introduce 
shadow quantifiers for all quantifiers. Instead, our procedure will silently assume 
their presence whenever it performs a degree shift. In the corresponding pre- 
EQR this can be recognized by assignments of the form x. t = p/£i, which cannot 
come into existence otherwise. 



6 Generalization and Extensions of the Method 

In this section we generalize Theorem [5] to admit more general pre-EQRs as 
input. Furthermore, we discuss heuristics for obtaining rational numbers or 
even integers instead of root expressions in our standard answers. 
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Corollary 7 (Generalized Computation of Standard Answers). Consider a 
closed Tarski formula ip = 3x n ... 3xiip(xi ,..., x n ). Assume that the follow¬ 
ing is a pre-EQR for ip: 


true 

x\ = e\ 

• %n — 


7i 

7n 


such that each is of one of the following forms: 

(a) where a, b, c, d £ Z[xi+i ,..., x n ], 

(b) a+ ^— ± e, where a, b, c, d € Z[xj+i,..., x n ], 

(c) ±oo, 

(d) tfx i+1 , where g G N \ {0}, 

where as usual “± ” denotes “± ” or Then we can compute root expressions 
e[, ..., eO each meeting either the specification (a) or the specification (d) above 
and 7 i, ..., 74 such that the following is a pre-EQR for ip as well: 


true 

x\=ef 

%n — 


7i 

7n . 


Proof. From a theoretical point of view, the treatment of e, = a+ CE — £ can 
be reduced to Theorem [5] via the introduction of artificial variables as we did 
for our example in (12 ) above. From a practical point of view, it is not hard to 
see how to algorithmically treat such expressions directly. Notice that then our 
corrected answer e) will generally be a rational number. As already mentioned 
in the proof of Theorem [5](c), one might heuristically even find an integer. In 
both cases the possibly non-trivial guard 7* has to be replaced by 7 \ = true. 

Next, the treatment of a+ C/r 4- £ and —00 in analogy to a+b E^ _ £ an d o0) 
respectively, is straightforward. 

Finally, having obtained algebraic numbers for 27+1, • • ■, x n , one can com¬ 
pute an algebraic number also for j^Xi+i with g G N \ {0}. □ 


The proofs for both Theorem[5]and Corollary [7] are constructive. Recall that 
the ordering of the variables within the given pre-EQR is such that quantifier 
elimination has taken place from the left to the right, while the construction of 
the standard answers proceeds from the right to the left. 

Consider the computation of ef for some e*,. Here, the quantifier elimination 
direction mentioned above has played an important role in our proofs: Although 
ek- 1-1, ..., e„ have been replaced with e/ffi, ■ ■ ■, efi, the expression efc is still 
valid. Taking that idea a bit further, we may replace ej, with any valid expression 
without affecting the validity of either e\, ..., ek -1 or eif+ 1 , ..., Ef. 

In fact, it is sometimes possible to convert a root expression into a rational 
number or even an integer as follows: Before processing e^, we check whether 
changing it to one of efc ± e yields a valid pre-EQR for <p as well. This can be 
done by means of the virtual substitution 


(jn A • • • A jk+i A 7 fe A • • • A 71 A ip) 

[xi //ei]... [x k -1 // e k -i\[x k // e k ± e\[x k+1 H efff 1 ]... [x n //e^]. 
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In the positive case, we process ± e instead of e*,. In terms of the proofs 
of Theorem [5] and Corollary [7] this leads to the cases (c) and (b), respectively, 
where we generally obtain a rational solutions el- and heuristically even integers. 

Finally, it is quite helpful in general to recognize rational numbers among 
all occurring real algebraic numbers. This holds in particular for the final a n , 
..., oq, as they correspond to the values of the back-substituted e^, ..., el, 
which may be complicated nested root expressions. For this one can use the 
following lemma. 

Lemma 8 (Rational Algebraic Numbers). Consider a real algebraic number 
a = ( a n x n + • • • + aso, ]l, w[), where do, ..., a n £ Z, ao > 0, /, u £ Q, l > 0. 
Assume furthermore that ]^, j[nZ = {z}. Then a £ Q if and only if a = 

Proof. Let a £ Q. From l > 0 it follows that a > 0, say a = |, where p, g £ Z, 
p > 0, q > 0. This admits the following factorization: 

n n— 1 

q ■ a.iX l = (qx - p) -^2 a i x% ■ 

2=0 2=0 

It follows that p | do, say pp' = do, and we obtain a = ^7 = On the other 
hand, l < < u, which is equivalent to ^ < qp' < 9 f-, and it follows that 

qp' = z. Together a = ^ The converse implication is obvious. □ 

The lemma can be straightforwardly generalized to arbitrary intervals ]l,u[. 


7 Implementation and Application Examples 

We have implemented our method in Redlog, which is a part of the computer al¬ 
gebra system Reduce. Reduce is freely available under a modified BSD license]]] 
Technically, our implementation is an extension of Redlog’s extended quantifier 
elimination rlqea by a switch rlqestdans, which toggles the computation of 
standard answers. 

In the following subsections we are going to revisit a number of applications 
of extended quantifier elimination that have been documented in the scientific 
literature. In each case we are going to briefly explain the underlying prob¬ 
lem, recompute the solutions with nonstandard answers, and finally compute 
solutions with standard answers using our approach as described in this article. 

Since Redlog is very actively developed and improved, and the considered 
applications date back up to more than 15 years, the nonstandard answers 
obtained here partly differ from those reported in the literature. Of course, in 
such cases both variants are correct. 

All computations have been carried out with the CSL version of Reduce, 
revision 2465, using 4 GB RAM on a 2.4 GHz Intel Xeon E5-4640 running 
64 bit Debian Linux 7.3. 


7.1 Computational Geometry 

Besides many standard problems from computational geometry, |Sturm and| 


Weispfenning (1997) consider in their Example 10 the reconstruction of a cuboid 


1 http://reduce-algebra.sourcef orge.net 
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wireframe from a photography taken from the origin along the :r 3 -axis with a 
lens of focal length 5. 

The answers obtained by extended quantifier elimination is going to describe 
vectors ei, e 2 , e 3 £ K 3 generating the cuboid together with a vector v £ R 3 
describing its translation from the origin. The input formula, which contains in 
addition points i £ R 2 on the camera sensor, contains 15 quantifiers: 


3ei3e 2 3e 3 3vVi((</ <■—*• tt 0 ) A 3k(59kv = (100,200, 295fc + 295))). 


The formula i/(ei,e 2 ,e 3 , v, i), which has been obtained by regular quantifier 
elimination earlier, generically describes that a point i lies in the image of a 
cuboid generated by ei, e 2 , e 3 , and translated by v. The formula 7To(i) is a 
quantifier-free description of one concrete image. The remaining part of the 
input formula fixes i = ()W, ^) to be the image of the origin of the cuboid. 

Extended quantifier elimination yields “true” if and only if 7Tq is a picture of 
a cuboid at all. In the positive case, the answers will provide suitable vectors 
ei, e 2 , e 3 , and v. 


For 7 Tq as considered by Sturm and Weispfenning (1997) in Example 10, 


the extended quantifier elimination yields “true” together with the following 
nonstandard answers: 


ei = ( 5oo 


7ooi 5ooi 


e 3 = 


lj 2 ’ 2 
— 109ooi 53ooi ooi 


65 


e 2 = ooi,2ooi, 


—24ooi 


26 ’~2~ l ’ v = ( 5ooi, lOooi, 


59ooi + 20 


Our method fixes ooi = 1, which yields the following standard answers: 


ei = 




/ 109 53 1\ 
v “65”’ 26’ 2y ’ 



The entire computation takes 189 s, of which the computation of the standard 
answers takes less than 1ms. 


7.2 Motion Planning 


Weispfenning ( 2001| ) has studied motion planning problems in dimension two. 
Both the object to be moved and the free space between given obstacles are 
semilinear sets. Extended quantifier elimination is used to decide whether a 
geometrical object can be moved from an initial to a final destination in at most 
n moves, where the trajectory of each move is a line segment. In the positive 
case, the answers describe the coordinates Ui, ..., u„ £ R 2 of the object after 
each of the n moves. Accordingly, the input formulas contain 2 n variables in 
the prenex existential block. 

We have applied our answer correction to three of the examples discussed 
by Weispfenning (2001). For the concrete input formulas and pictures of the 


scenery we refer to that publication. 
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Example 

Ul 

U 2 


u 3 

time 

6.4 

(5 £1,5 £i) (5 £i, 2e 2 1+1 ) 

( 9 , 1 ) 

0.06 s 

6.8 

(0,3 + £i) 

(3-£ 1 , 6 ) 


(7 6 ) 

9.5s 

6.9 

(0,3 + £i) 

(3-£ 1 , 6 ) 



0.28 s 

Table 1: Summary of nonstandard answers and computation times for motion 

planning examples considered by 

Weispfenning 

(2001). 



Example 

£i 

Ul 

u 2 


u 3 

6 4 

3 

(77 77 \ 

(77 5 


(9 9 ) 


16 

V 16 ’ 16/ 

V16 5 16/ 


2 / 

6.8 

l 

(0,4) 

(2,6) 


(7,6) 

6.9 

l 

(0,4) 

(2,6) 




Table 2: Summary of standard answers for motion planning examples considered 
by Weispfenning (2001). In all cases the time spent for the computation of £\ 
was less than 1 ms. 


For Example 6.4, we obtain the following nonstandard answers: 


Ui = (5 - £i, 5 - £i) , u 2 



£i, 


-2ei + l \ 

2 )' 



Our method fixes £i = ^, which yields the following standard answers: 


Ul 


77 77 
16’ 16 


yrr, tt: , u 2 


77 5 
16’ 16 


7Ii TX I ) U 3 



The entire computation takes 60 ms, of which the computation of the standard 
answers takes less than 1 ms. Tables [T| and [2] summarize these results along with 
the two other examples. 


7.3 Models of Genetic Circuits 


Recently, symbolic methods for the identification of Hopf bifurcations in vector 
fields arising from biological networks or chemical reaction networks have re- 


ceived considerable attention in the literature 

(Sturm and Weber 

to 

o 

o 

00 

Sturm 

et al. j 

2009 

Errami et al. j, 

2011 

Weber et al. 

>011 

Errami et al. 

2013). 

Given 

ethod, 

a polynomial vector field, 

El Kahoui and Weber 

(2000 

) introduced a m 


which automatically generates first-order Tarski formulas describing the exis¬ 
tence of a Hopf bifurcation in terms of the parameters. Then real quantifier 
elimination is applied to obtain corresponding necessary and sufficient condi¬ 
tions. For efficiency reasons, one often existentially quantifies all parameters 
and applies extended quantifier elimination. In the positive case, the answers 
provide one set of parameter values giving rise to a Hopf bifurcation. 


Based on models introduced by Boulier et al. (20071, Sturm and Weber 


(2008) and Sturm et al. (2009) used the approach sketched above to automat¬ 


ically derive the existence of Hopf bifurcations for the gene regulatory network 
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controlling the circadian clock of a certain unicellular green alga. The input 
formula is 

3(0 <viA 0 <v 3 A 0 <v 2 A 0 <$A 0 < 7 oA 0 </^A 0 <( 5 A 0 <a 
A $ • (70 — vi — viv§) = 0 A A 1 V 1 + 70 /z - v 2 = 0 
A 9 a( 7 o — vi — V 1 V 3 ) + <5(v 2 — v 3 ) = 0 A 0 < iM + i9vg<5 + 9 Aii?viV 3(5 
A 162'dv 3 7 avi + 162'daviVg + 162aviv 3 5 + 1 ? + 2 $Vg<5 + $ 2 Vg 8 c) 

+ + 2 #6 + 81avivfiM + 81avivf $6 + S 2 + tfS 2 + d 2 6 + ft 2 

+ 2+v| + i9 2 vl 8 + 6561a 2 v 2 v 3 6 + 2+v^ + S + 81aviv| + tfv|(5 2 
— 9Ai$v 1 V3<5 = 0 ), 


for which we obtain the following nonstandard answers: 


7o 


8 ^002 19 003 + 16 ^/002 10 003+8-§/002 003 
729 oo^oo 2 + 1458 oo^oo 2 + 729 oo^oo 2 — 4860010 O 2 OO 3 — 486001002003+9002003 5 




729oo^oo2+1458oofoo2+729oof 002—486ooi oo| 003—486001002 003+002 oo|—8oo| 
8002003 + I6002003+8003 


— 6561 oo|oo 2—26244 oo|oo 2 —39366oo^ oo| —26244oo^oo2 —656 loo^+437400^002003 
+1312200^002003+1312200^002003+437400^003 — 54001002003 — 54001003+003 
6561oo^oo|+32805oo^oo2+65610oo^oo2+65610oo^oo2+32805oo^oo2+6561oo^ 5 

—874800^002003—3499200^002003—5248800^002003 —3499200^002003 —8748oo^oo3 
+307800^002003+ 9234 oo^oo 2 003+923400^002 003+307800^003 — 108001002003 
— 2 I 6001002003 — I 08 OO 1 OO 3 +OO 2 OO 3 +OO 3 

8 y / 00 2 10 00 3+8 00 2 00 3 

729oo^oo2+1458oo^oo2+729oo^oo2—486001002003—486001002003+9002003 5 


v 2 = ^ 00 ^, v 3 = -^ 002 , 

a = 

Our method fixes ooi = 
following standard solution: 

1, oo 2 

69984800• ^9 


70 ~ 616061191401’ 

= 

6998480 • s/9 


Vl ~ 616061191401’ 

V 2 = 

a = 1, 

5 = 


3827162521 

69984800 


Ai = oo 3 . 

= 87481, which yields the 


Q _ 7652917261 
“ 76056937210’ 

v 3 = Vq, 


Ai = 87481. 


The entire computation takes 370 ms, of which the computation of the standard 
answers takes 140 ms. 


7.4 Mass Action Systems 


We are now going to discuss another example about Hopf bifurcation. This 
time, the considered system is a chemical reaction system, viz. the famous and 
well-studied phosphofructokinase reaction. It has been firstly analyzed with 
symbolic methods by Gatermann et al. (2005 Example 2.1). We adopt here the 
first-order formulation discussed by Sturm and Weber] (2008) and Sturm et al. 
(2009) following the approach sketched in the previous subsection. 
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We obtain nonstandard answers of the following form: 


k 2 \ = #21(001,002, 

fc4 6 = #46(001,002, 
&56 = #56(c»l) 002: 

v 2 = y 2 (ooi,oo 2 , 


003,004, £4), 

k 3 4 

003,004, 005, £1), 

ke 4 

003,004,005,£1) , 

Vl 

03, 004,005, £1), 

V3 


001, /C43 — oo 2 , 

005, ^65 — OO3, 

CX) 2 004 
OOl ’ 

004. 


The nonstandard terms A' 2 i, • • •, # 56, V 2 are so large that we cannot explicitly 
display them here. To give an idea, A'46 would fill more than 16 pages in this 
document. 

Our method fixes 001 = oo 2 = oo 3 = 004 = 1, oo 5 = 20, and e 1 = 2(V2 — 1), 
which yields the following standard solution: 


fc 2 i — 3, 

, v / 3457 + 1 

«4 6 — -g-j 

, -\/3457+ 159 

«56 = - T. - 

6 

-\/3457+ 159 

v 2 = - 

2 24 

The entire computation takes 13.2 s, 
answers takes 0.1s. 


&34 — 1 ) ^43 — 1) 

&64 = 20, k e5 = 1, 

vi = 1, 
v 3 = 1. 

which the computation of the standard 


7.5 Sizing of Electrical Networks 

Sturm| (fl999a] Section 5) has applied generic quantifier elimination to the sizing 
of a BJT amplifier. Description of a circuit is given as a set of operating point 
equations E\ and a set of AC conditions A 2 . For the concrete equations we 
refer to the mentioned publication. The system E\ A E 2 has to be solved w.r.t. 
the main variables M = {n,... ,^, 03} in terms of parameter variables P = 
{v C ci *4high, aiowjP) ~in, Ajut}■ Fixing values of the parameters to 


Vcc — 3, Uhigh — 3, Ulow — 2, p — 12, Z' ln — 5, ^out — 


the answers contain one nonstandard term: 

4457058395 ^ 4457058395 

ri ~ 5180672 ’ ?2 _ 2590336 


4457058395 

1295168 


4182864929375836679 

128066211840000 


r <5 = ooi, 


282999424999 

804520000 


25509595605337086755 

20836792295619328 


647584 

13371175185' 


Our method fixes ooi = 1, which yields a standard answer for r5. The entire 
computation takes less than 2 ms, of which the computation of the standard 
answer takes less than 1 ms. 


21 






















7.6 A Linear Feasibility Example 


Korovin et al. (2009, Section 9) have considered a small linear existential prob¬ 


lem to demonstrate the difference between their conflict resolution method and 
the Fourier-Motzkin elimination method. The following are nonstandard an¬ 
swers for that problem computed by Redlog: 


8 


xi = - 


13’ 


X 2 


1 — 65ei 
65 


*3 


-14+ 13er 2 
13 


X 4 


-302 - 195ei + 65 e 2 
130 


x 5 


-30 + 26e 2 
39 


Our method fixes Ei = ^ and e 2 = pg, which yields the following standard 
answers: 


8 


xi = - 


13’ 


x 2 = 0, X 3 = -1, 



x 5 = - 


28 

39' 


The entire computation takes 3 ms, of which the computation of the standard 
answers takes less than 1ms. 


8 Conclusions and Future Work 


We have introduced extended quantifier elimination as a general concept, and 
focused on virtual substitution as one possible method for its realization. Suc¬ 
cessful applications of extended quantifier elimination via virtual substitution 
have been documented in the literature over the past two decades. One problem 
there was that the answers obtained via virtual substitution in general contain 
nonstandard symbols, which can be hard to interpret. For fixed parameters 
the present work resolves this issue by providing a complete post-processing 
method for fixing all answers to standard real numbers. We have implemented 
our method, and applied it to various extended quantifier elimination problems 
from the literature. In these experiments we have generally obtained standard 
answers that are meaningful in terms of the modeled problems. In most cases 
our post-processing method does not significantly contribute to the overall com¬ 
putation time. It is noteworthy that our method is compatible with our recent 


work on combining virtual substitution with learning techniques (Korovin et al. 


2014). 


Recall from our discussion in Section [6] on finding integer and rational an¬ 
swers that there is often a considerable degree of freedom in the choice of stan¬ 
dard answers. In future this can be further exploited in many interesting ways: 
For instance, using extended quantifier elimination methods as a theory solver in 


the context of Satisfiability Modulo Theory (SMT) solving (Nieuwenhuis et al. 


2006), in particular when combining several theories in a Nelson-Oppen (1979) 


style, one is specifically interested in avoiding identical answers for different vari¬ 
ables. Alternatively, one can try to identify certain variables, which might be 
interesting in certain contexts. As another option, there is only a small step to 
automatically generating for a given pre-EQR code for an interactive procedure 
that suggests ranges and finds possible choices for certain variables in coopera¬ 
tion with the user. In cooperation projects with researchers from the sciences we 
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have had the experience that those researchers often have a surprisingly precise 
idea about reasonable choices for certain variables. 

A theoretically way more challenging step would be the generalization of our 
method to the parametric case. Recall that Proposition [T] has shown that it is 
not possible in general to determine real standard values for infinitesimals and 
infinities without fixing values for the parameters beforehand. Nevertheless, 
it might well be possible to devise on the basis of our work here a complete 
method for symbolically replacing nonstandard symbols with standard terms. 
In the example in Proposition [l] the infinitesimal £\ could be replaced e.g. with 
yielding a standard extended quantifier elimination result. 
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